Listing of Claims 



1.-24. (Canceled) 

25. (Currently Amended) A conversational computing system, comprising: 

a multi-modal CUI (conversational user interface) manager, operatively connected to a 
plurality of I/O (input/output) Tenderers, which can receive for receiving input queries and input 
events across different user interface modalities of one or more active applications and generate 
g e nerating output messages and output events in connection with the one or more active 
applications an activo application in one or more of the different user interface modalities; 

a conversational kernel for generating multi-modal dialogs in response to the input 
queries and input events, and for managing context associated with the one or more active 
applications; and 

a conversational API (application program interface) for providing an interface between 
the one or more active applications and the conversational kernel. 

26. (Original) The system of claim 25, further comprising: 
a conversational engine API; and 

a plurality of conversational engines, wherein the conversational kernel controls and 
accesses the conversational engines through the conversational engine API. to process the input 
queries and input events and to generate the multi-modal dialog and output events. 

27. (Original) The system of claim 25, wherein the conversational kernel provides 
conversational services and behaviors that are accessible by an application through the 
conversational API. 

28. (Original) The system of claim 27, wherein the conversational services and behaviors 
comprise one of conversational security, conversational customization, conversational search, 
conversational selection, conversational help, conversational memorization, conversational 
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summarization, conversational agents, conversational formatting, conversational prioritization, 
conversational re-direction, conversational categorization, conversational abstraction and object 
management, conversational navigation, conversational undo, and a combination thereof. 

29. (Original) The system of claim 25, wherein the conversational API comprises a 
library comprising library functions of conversational foundation classes (CFCs) and 
fundamental dialog components, wherein the CFCs and fundamental dialog components are 
accessible through the library for constructing conversational objects, wherein the conversational 
objects are employed for one of performing conversational procedures and building 
conversational applications. 

30. (Original) The system of claim 29, wherein the CFCs can share context and be 
activated in parallel within an application or across a plurality of applications. 

31. (Original) The system of claim 30, wherein the CFCs and fundamental dialog 
components comprise one of CUI building blocks, conversational platform libraries, dialog 
modules, dialog scripts, beans, conversational gestures, and a combination thereof. 

32. (Original) The system of claim 31, further comprising a conversational browser, 
wherein the CFCs, dialog components, CUI building blocks, conversational platform libraries, 
dialog modules, dialog scripts, beans, conversational gestures, and conversational API are loaded 
into the system through CML (conversational markup language) pages that are processed via the 
conversational browser. 

33. (Original) The system of claim 29, wherein the conversational objects are 
implemented one of declaratively, imperatively and a combination thereof 
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34. (Original) The system of claim 25, wherein the conversational kernel is a platform 
that executes on top of one of an operating system, a real-time operating system, a virtual 
machine and a browser. 

35. (Original) The system of claim 25, wherein the conversational kernel executes as an 
operating system service layer. 

36. (Original) The system of claim 25, wherein the system executes on one of a personal 
computer platform, a server platform, an embedded client device platform and a distributed 
combination of these platforms. 

37. (Original) The system of claim 25, further comprising: 
a plurality of I/O resources; and 

an I/O API for interfacing with the plurality of I/O resources and for registering the 
plurality of I/O resources with the conversational kernel. 

38. (Original) The system of claim 37, wherein the conversational kernel comprises a 
conversational transcoder for providing adaptation of the behavior, CUI and dialog presented to a 
user based on capabilities of the I/O resources and conversational engines. 

39. (Original) The system of claim 37, wherein the I/O API layer comprises one of I/O 
abstractions, user interface abstractions, device abstractions and a combination thereof. 

40. (Original) The system of claim 26, wherein the conversational engines comprise 
NLU (natural language understanding) and NLG (natural language generation) engines, and 
wherein the multi-modal dialogs comprise NLU and NLG dialogs. 
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41. (Original) The system of claim 40, wherein the conversational kernel provides 
support at the dialog management level for NL (natural language) and use of context for 
disambiguation and mixed initiative. 

42. (Original) The system of claim 25, wherein the conversational kernel comprises: 
a dialog manager for managing dialog across active applications and for selecting an 

active dialog, context and application based on input queries; 

a resource manager for managing and allocating conversational engines that are used 
during execution of conversational tasks; 

a conversational task dispatcher for coordinating and dispatching conversational tasks; 

and 

a context stack for accumulating a context of an active discourse of a conversational task, 
the context comprising query arguments, a list of attribute value - uples and conversational state. 

43. (Original) The system of claim 42, wherein the context stack comprises a global 
history of context. 

44. (Original) The system of claim 42, wherein the context stack comprises a meta- 
information repository. 

45. (Original) The system of claim 44, wherein the meta-information repository 
comprises a-priori known information. 

46. (Original) The system of claim 44, further comprising a meta information manager 
for managing the meta-information repository, wherein the meta-information comprises a 
plurality of abstract categories associated with elements comprising one of files, directories, 
objects, data stream handles, networks, peripherals, hardware, applications, networked file 
systems and a combination thereof. 
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47. (Original) The system of claim 46, wherein the meta-information is used to provide 
shortcuts to the elements. 

48. (Original) The system of claim 46, wherein a user can navigate the categories of the 
meta- information through multi-modal conversational dialogs that comprise filling sets of 
attribute values out of a set of possible query types, and wherein the user can refine or modify the 
result of current navigation queries based on similarities of the corresponding categories. 

49. (Original) The system of claim 46, wherein the meta-information provides a-priori 
knowledge information for the categories of meta-information. 

50. (Original) The system of claim 44, wherein the meta-information comprises user 
meta- information representing one of user preferences, security, habits, biometrics, behavior and 
a combination thereof. 

51. (Original) The system of claim 50, wherein the user meta-information is one of 
provided directly by the user, learned from past usage of the system by the user, and a 
combination thereof. 

52. (Original) The system of claim 42, wherein the conversational kernel further 
comprises a back- end abstraction layer for accessing back-end logic via the dialog manager. 

53. (Original) The system of claim 25, further comprising a communication stack that 
implements conversational protocols for exchanging information with a conversationally aware 
system, wherein the conversationally aware system comprises one of a remote application, a 
remote device, a remote conversational computing system, and a combination thereof. 

54. (Original) The system of claim 53, wherein the conversational protocols comprise 
distributed conversational protocols for exchanging information comprising one of 
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conversational state, conversational arguments, context, conversational engine API calls, results, 
and a combination thereof. 



55. (Original) The system of claim 53, wherein information exchanged between 
applications through the conversational protocols comprises a description of a conversational 
state of the applications, wherein the information representing a conversational state comprises 
one of a grammar, a vocabulary, acoustic models, language models, prompts, synthesis details, 
parsing details, tagging details, information to manage the dialog, and a combination thereof. 

56. (Original) The system of claim 53, wherein information exchanged through the 
conversational protocols comprises a modality-independent description of an interface of a 
remote control unit, wherein the interface allows the user to remotely control a conversationally 
aware appliance though the remote control unit. 

57. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational discovery protocols for automatically discovering the conversationally aware 
systems, and wherein the information exchanged through the conversational discovery protocols 
comprises broadcast requests for handshake, exchange of identifiers, exchange of handles for 
first registration and exchange of handles for first negotiation. 

58. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational negotiation protocols for exchanging information to negotiate network topology 
between the system and a conversationally aware system. 

59. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational registration protocols for exchanging registering information, wherein the 
registering information comprises one of conversational capabilities, conversational state, 
context, and a combination thereof. 
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60. ~ 96. (Canceled) 



97. (Currently Amended) A conversational virtual machine, comprising: 

a kernel adapted to manage dialog and context, conversational engines and resources and 
communication across on e of different platforms, applications, devices and-a or combinations 
thereof, each having one or more having different user interface modalities, to provide a 
coordinated, universal conversational user interface (CUI) across the different user interface 
modalities; and 

an API (application program interface) comprising abstractions adapted to access 
conversational services from the kernel on behalf of said platforms, applications, and devices or 
combinations thereof . 

98. (Original) The conversational virtual machine of claim 97, wherein the 
conversational virtual machine comprises a shell that executes on top of one of an operating 
system, a real-time operating system, a virtual machine, and a conversational browser. 

99. (Original) The conversational virtual machine of claim 97, wherein the 
conversational virtual machine executes as an operating system service layer. 

100. (Original) The conversational virtual machine of claim 97, further comprising an 
engine API comprising abstractions adapted to access a conversational engine. 

101. (Original) The conversational virtual machine of claim 97, wherein the API 
comprises a plurality of conversational foundation classes that are accessible through library 
functions for building one of conversationally aware applications, dialog components for 
performing specific reusable dialog tasks, and both. 
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102. (Original) The conversational virtual machine of claim 101, wherein the 
conversational foundation classes comprise conversational gestures that characterize a modality- 
independent dialog. 

103. (Previously Presented) The conversational virtual machine of claim 97, wherein the 
conversationally aware applications and dialog components are implemented one of 
declaratively, imperatively, and a combination thereof. 

104. (Original) The conversational virtual machine of claim 97, wherein the kernel 
comprises a task manager adapted to drive a conversational engine and a task, process or thread 
running on the conversational virtual machine. 

105. (Original) The conversational virtual machine of claim 97, wherein the kernel 
comprises: 

a resource manager adapted to manage one of local resources, distributed resources, and 
both; and 

an input/output (I/O) manager adapted to manage multi-modal I/O events. 

106. (Original) The conversational virtual machine of claim 97, wherein the kernel 
comprises: 

a dialog manager adapted to manage conversational dialog across registered applications; 

and 

a context stack for maintaining the context of an active application or task under the 
control of the dialog manager. 

107. (Original) The conversational virtual machine of claim 106, wherein the kernel 
further comprises an arbitrator for arbitrating a target application of an I/O event between the 
registered applications. 
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108. (Original) The conversational virtual machine of claim 106, wherein the API 
comprises conversational protocols adapted to provide distribution of the conversational virtual 
machine. 

109. (Original) The conversational virtual machine of claim 108, wherein the distribution 
of the conversational virtual machine comprises distribution of functions and components of the 
conversational virtual machine across multiple devices or resources that collectively contribute to 
providing a complete functionality of the conversational virtual machine. 

110. (Original) The conversational virtual machine of claim 108, wherein the distribution 
of the conversational virtual machine comprises distribution of functions of the conversational 
virtual machine among a plurality of conversational virtual machines. 

111. (Original) The conversational virtual machine of claim 110, wherein the role of 
each of the plurality of conversational virtual machines is dynamically negotiated between the 
conversational virtual machines. 

1 12. (Original) The conversational virtual machine of claim 108, wherein the distribution 
of the conversational virtual machine comprises distribution of the dialog manager and context 
stack across the registered applications. 

113. (Original) The conversational virtual machine of claim 108, wherein the 
conversational protocols comprise conversational distributed protocols adapted to allow 
coordination of a dialog among a plurality of applications and devices. 

1 14. (Original) The conversational virtual machine of claim 113, wherein the plurality of 
applications and devices comprise silent partners. 
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115. (Original) The conversational virtual machine of claim 108, wherein the 
conversational protocols comprise negotiation protocols adapted to allow the kernel to 
dynamically negotiate one of a master/slave, a client/server, and a peer-to-peer topology with at 
least one kernel of a remote conversational virtual machine. 

116. (Original) The conversational virtual machine of claim 97, wherein the 
conversational virtual machine is implemented as program code comprising one of a 
programming language, scripts and a combination thereof. 

1 17. (Original) The conversational virtual machine of claim 116, wherein the program 
code comprises instructions for transcribing input events into ASCII input streams and 
processing the ASCII input streams as objects. 

118. (Original) The conversational virtual machine of claim 117, wherein the ASCII 
input streams comprise a list of attribute- value n-uples. 

119. (Original) The conversational virtual machine of claim 116, wherein the program 
code comprises instructions for comparing dialogs with conversational logic. 

120. (Original) The conversational virtual machine of claim 119, wherein the 
conversational logic comprises logic statements including one of true, false, incomplete, 
ambiguous, different/equivalent for ASCII comparison, different/equivalent for NLU-converted 
query comparison, different/equivalent for active query field comparison, unknown, 
incompatible, incomparable, and a combination thereof. 

121 . (Original) The conversational virtual machine of claim 97, wherein the 
conversational virtual machine is implemented as an interface for a UCRC (universal 
conversational remote control), wherein the UCRC is used to control home appliances that are 
conversationally aware. 
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122. (Original) The conversational virtual machine of claim 121, wherein the UCRC 
comprises a speech- enabled PDA (personal digital assistant) device. 



123.-124. (Canceled) 
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